# Chinese NLP Optimization

A Chinese pre-trained BERT model employing whole word masking strategy, designed to accelerate Chinese natural language processing research.

Chinese ELECTRA is a Chinese pre-trained model released by the HIT-iFLYTEK Joint Lab based on Google's ELECTRA model, featuring compact size and superior performance.

MacBERT is an improved BERT model that uses a novel MLM as a corrective masked language model pre-training task, alleviating the discrepancy between pre-training and fine-tuning stages.

A Chinese word-level RoBERTa medium model pretrained on CLUECorpusSmall, outperforming character-based models in multiple tasks

A Chinese pretrained BERT model using whole word masking technology, designed to accelerate the development of Chinese natural language processing.